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ABSTRACT 

One of the major objectives of this study was to 
obtain an estimate of the reading skill level an individual would 
need in order to be able to read and understand the training and job 
materials in his Air Force career ladder. A methodology developed by 
Mockovak (1974) for comparing training and job reading requirements 
was used ro calculate the reading requirements levels for 56 career 
ladders. The application of the reading requirement methodology was 
accomplished by Air Force subject matter specialists (SMS) in each of 
the 56 career ladders. After collecting all of the relevant reading 
material in a career ladder, the SMS then randomly selected 150 word 
samples from the materials. The FORCAST readability formula was then 
applied to obtain an estimated grade level difficulty, and trainee 
and job incumbent scores were converted to estimated reading grade 
levels using a validated conversion procedure. The results indicated 
that both reading skills and requirements varied widely between 
career ladders, that materials in many career ladders were not 
written to the reading skill level of the user, and that, although 
the average reading ability level of personnel dropped in many career 
ladders, the reading demands often did not drop accordingly. (KE) 



ERIC 



AFHRL-TR-74-90 



AIR FORCE n 



CD 

o 
I — ( 

CD 



0% OEPARTMENTOf MkALTM 
EDUCATION A ^wetTARF 
NATlONAt INSTITUTE OF 
EOUCATlON 
... s OOvv ^'fS^ -A. HC^S Ul^**'' 
f C» f ^Av V A. «fc< t ' .10 » «UV 

At N . • N'S Ok . . A " OP N'OSS 

Sf J» < < A. SAT v>SA. NST • U 01 



SCOPE OF INTEREST NOTICE 



CP- 



Id oiii |u<J'j»*««M'ru, tftiN uinent 
»4 ilv() ii> »nten 41 tu th« tie Mini| 
U>uiC4 nottfti U> th«' nqht li»<lf« 
in«j 4houl<J fvUvi I thfi< iptM Ml 
l%>u (V <kt view 



LITERACY SKILLS AND REQUIREMfcNIS 
IN AIR FORCE CAREER LADDERS 



BV 

William P. Mockovak, Capt, USAF 



TECHNICAL TRAINING DIVISION 
Lowry Air Force Base, Colorado 80230 



H 
U 
M 
A 
N 

R 
E 
S 
0 
U 
R 
C 
E 

S LABORATORY 



December 1974 
Final Report for Period January 1973 - September 1974 



Approved for public release. distnbutK^n unhmtted. 



AIR FORCE SYSTEMS COMMAND 

BROOKS AIR FORCE BASEJEXAS 78235 

2 



NOTK^h 



\W\cn I S (joxermuent (ir.iwiiiys. spLMfication'*, or other data are used 
lor an> purpose other than a definitely related (iovernnienl 
procurenien; operation, the (lovcrnnient thereby incurs uo 
respoiisihiht) nor any ol>htMtion wliat soever, and the tact tliat tlic 
(i(»veriinient nu> have rormuiatcd, Turnislied, or m any wa> supplied 
the said dra\MniLs.^ spccitlcatu)ns, ox other data is not to be regarded by 
implication otherwise, as in any manner licensing the liolder or any 
otiier person or ci>rporation. or ci>n\eying any riglits or perinissioit to 
nianulaciiire. use. or sell an\ patented invention that may in any way 
be related thereto. 

Tills linal report wa!> siibnnttcd l>y Teclinical Training Division. Air 
l*orce Ihiman Resources Laboralor\'. Li>\vry Air Force Base . Colorado 
S()230. under project 1121. with Hq Air l-orce Human Resources 
Liborator\ (AFSC). Brooks Air Force Base. Texas 78235. 

Tills report has been re\iewed and cleared for open publieation and/or 
public release by the appropriate OtTice of Information (0!) in 
accordance \Mth W'R 1*?0-1 7 and DoDD 5230.*> There is no objection 
to unlimited distribution of this report to t!ie public at large, or by 
DDC to the National Technical Inlormation Service (NT IS). 

Tins teclir!ical report has been reviewed and is approved. 

MARTY R. ROCKW AY. Technical Director 
Technical Training I>iMsion 

Appro* ed for publication. 

HAROLD FISCHI R. Colonel. USAF 
Comniander 



ERIC 



3 



ERIC 



REPORT DOCUMENTATION PAGE 


READ INSTRUCTIONS 
BEFORE COMPLETING FORM 


t REPORT SUMBER |2 GOVT ACC ESSION NO 

AFHRL.TR.74-90 j 


3 recipient's Catalog ►•umber 


4 TITLE Kind Subtitle) 

LITKRACY SKILLS AND RhQUIRhMI-NTS 
IN AIR FORCL CARliLR LADDLRS 


5 TYPE OF REPORT 4 PERIOD COVERED 

Fmal 

Jamiars' 1973 September 1974 


6 PERFORMING ORG REPORT NUMBER 


William P Mockovak 


8 CONTRACT OR GRANT NUMBERfs; 


9 PERPORMISG OHGANlZATfON NAME AND ADDRESS 

Technical Training Division 

Air Force Human Resources Laboratory 

Lowry Air Force Base. Colorado 80230 


10 PROGRAM ELEMENT. PROJECT. TASK 
AREA & WORK UNIT NUMBERS 

62703 F 
rt2I040S 


n CO»^TROLLING OFFICE NAME AND ADDRESS 

Hq Air Force Human Resources Laboratory (AFSC) 
Brot)ks Air Force Base. Texas 78235 


12 REPORT DATE 

December 1974 


»3 NUMBER OF PAGES 
34 


14 MONITORING AGENCY NAME A ADDRESSfi/ dtttcrcnt Irom Cnntrolltng Otltcc) 


K'l SECURITY CLASS, (ol thts report) 

Un.'lassificd 

tSfl DECLASSIFICATION DOWNGRADING 
SCH £OULE 


•6 DISTRIBUTION STATEMENT ^ol thts Report) 

Approved for public iciease, distribution unlimited. 


•7 DISTRIBUTION STATEMENT (ol the abstract entered in Block 20. it dtllerent irom Retort) 


»8 SUPPLEMENTARY NOTES 



19 KEY WORDS ^Continue on reverse »tde tl necessary and Identlly by block number) 

literacy readability 

reading reading skills 

reading grade level literacy skills 
reading requirements 



20 ABSTRACT fContlnue on reverse stde U riece^sary and Identlly by block number) 

In a previous study (Mockovak. 1974b), a methodology for estimating the reading demands of 
training litcraturc.> as well as the average reading ability of groups of airmen, was demonstrated in five 
technical training areas. The methodology was designed to be objective, inexpensive, not overly time 
consuming, and simple enough to be accomplished by Air Force subject matter experts. 

In the present study, this methodology was applied to 56 career ladders by Air Force subject matter 
experts in an effort to determine. (1) the reading demands of different career ladders, (2) the average 
reading grade level of personnel in those ladders, and (3) the reading demands of different training materials 
(CDCs, TOs^and resident training literature). 



EDITION OF 1 NOV 65 IS OBSOLETE 



Unclassified 



SECURITY CLASSIFICATION OF THIS PAGE (When Data Entered) 



Unclassified 



SECURITY CLAb:> FiCAT.Qn Of TntS PAGE<W7>on Qmta Entered ) 

Item 20 (continued) 



In general, the results indicate a wide variation in both reading skills and requirements, within, as well 
as between career ladders. 



Unclassified 



ERLC 



SECURITY CL ASSIFICATJON OF THIS PAGEftWion Data Entered) 



SUMMA'^Y 



Problem 

Since the incei)t»on ol' the all-volunteer forLe. the potential hab exited tor sit-niHcant chanties in the 
educational characteristics of ne\v Air Force accessions Althoiiiih educational levels ir.:i> worsen or 
improve, the need exists for some objective means ol' comparing training jnd job rcadinii requirements with 
the reading skills of Air Force personnel To address this problem, Mockovak ( U>74b) demonstrated one 
possible inethodologv in five tcehniLal courses. The results supported the feasibility of the approach, 
therefore, the primar\ purpose of this study was to apply the methodology in an operational Air Force 
environment. 

Approach 

The methodology utilized in this study was chosen because it was found to be objective, inexpensive, 
not i»verly time consuming, and simple to understand and apply. The methodology was applied in 56 Air 
Force career ladders, representing 35 career fields, by Air Force subject matter experts and their assistants. 
The sample of career ladders was chosen to be as representative as possible of the spectrum of Air Force 
career ladders The methodoi'jgy . itsclC consists of two basic steps (1) subject matter e.xperts performed a 
readability analysL> of random samples of reading material from their specialties using the FORCAST 
readability fonnula. and (2) trainee and job incumbent AQL scores were converted to estimated reading 
grade levels using a valid;ited conversion procedure (Madden & Tupes. 1%6). 

Results 

In general, it was revealed that both reading skills and requirements varied widely between career 
ladders. It was also discov-.-d hit in many career ladders, materials were noc written to the reading skill 
level of the user, and, morv importantly, as the average reading abihty level of personnel dropped in 
different caretr ladders, the ;':^d!ng demands imposed on trainees and job incumbents often did not drop 
accordingly. 

Across all 56 career ladders, it was found ^••a^ reading requirement levels (RRL) varied from a low of 
iO.6 in the Cook career ladder to a higli of 14.0 in the Telephone Switching Equipment Repairman ladder 
(average = 12.3). Reading grade level varied fro .i an average of m the Aircraft Pneudralic Repairman 
specialty to 14.6 in the Programming Specialist ladder. For personnel m all 277 Air Force career ladders, 
the estimated average reac'ing grade level is 10.8. 

In terms of the relative difficulty of differerU types of reading matcn.il.. technical orders were more 
difficult on the average, but the extreme variability betwe»Mi career ladders makes such an overall 
comparison essentially meaningless. 

Discussion 

The reading requirement levels (RRL) obtained in this study are statistical estimates ol the reading 
skill levels required by Air Force personnel to read and understand the written material in their specialties. 
It should be emphasized, nowever. that the RRLs are only general estimates of reading demands. It was not 
possible within the constraints of this study to deterrr ne what effect job experience had on reducing a 
job^s reading demands, or to estimate the relative importance of reading ability in disparate career ladders- 
Obviously, reading skills are more important in certain career fields than others. RRLs. as well as estimates 
of average reading ability personnel, should be combined with the practical experience of training 
managers in determining if job and training matenals are being written at the proper readability level for the 
intended user. Nevertheless, the data presented in this study allow comparisons to be made between career 
ladders in terms of reading demands, and more importantly , if reading problems exist, a determination can 
be made if the problems are the result of poorly written reading materials, inadequate readmit skills of 
personnel, or a combination of both factors. 



ERLC 



1 

0 



m i u'l 



TIun Il\Iu;!^,i! report b U\c ".^1 :jp iloalini; with An ! ..mini: Coinin:iiui RPR 
7:->^. "'IXMci-.aiimi: Ri.nimiiS! '\ /^''.....i ncnls of Air i'<Ma' ( jiocr l.addors The 
J.iM prosciKCki rcpiosciu the aiim: .A\\ . tu b ol* imn:cioiKs Air /orco subject manor 
c\pcriN.fumc\cr.NpL\ia! thanki* .iic k'-ia '.'-..j " \V.i\ no Shoie ( AU ) and (apt IcsO. 
Rodinanii ( \T( ] ! S| ) t^r ilicir iinq .'ssistancc in pianniiii: and coordinating ATC 

support Coinpuici Mi^ipori uas i.Vtdo i>0hsihio through \hc cooperation ol Mr James D. 
Soutcr (AFHRl SM\) and. in addif )n. I \u>uld like to gratcl'illy acknowledge ti^^ 
assbiantc and ^onsrniLti\c cnticiMii provided b\ Ur Ronald Burkett, Maj Philip DeLco, 
ind Dr Mart) Rockua\ I M MRLTD thnnighout tlie duration of this project and in the 
preparation ot this Imal report 



ERLC 



2 

7 



TABLH OF CONTENTS 



Pa e 



I Introduction . . ... ... 5 

II Approach . 5 

Reading Requirement Metliodology ... 6 

III. Results ... 7 

Rchab'.hty of Methodology .... . . . . 7 

Reading Requirement Levels of Materials and Literacy Gaps . . . 7 

Reading Ability Levels of Personnel ^> 

Readability of DitTcrent Publications 13 

Decision Rules for Determining Literacy Gaps and Readability Specifications . ... 13 

IV Conclusions and Recommendations . . . . . 20 

References . ... . ... .... 24 

Appendix A. Estimated Average Reading Grade Level of USAF Personnel by Career Ladder . . 25 

LIST OF TABLED 

Table Page 

1 Reading Requirement Levels H 

2 Average Reading Requirement Levels for Career Fields 10 

3 Average Estimated Reading Ability by Career Ladder . . . 11 

4 Average Estimated Reading Ability by Career Vvh^ 12 

5 Readability Daia for Training Manuals . . . 14 

6 Readability of Technical Training Materials . . 15 

7 Readability Data for Technical Orders 15 

8 Readability Data for Career Development Courses 16 

9 Literacy Gaps Resulting trom Different Decision Rules ... . 17 

10 Literacy Gaps in 10 Career Fields witli Readmg Problems ... 1^ 

11 Readability Specifications for Career Ladders . . 19 



ERLC 



3 

8 



LI ritKACY SKll LS AND RhQUlRliMl NTS 
IN MR FORCr: CARLLR LADDhRS 



I. IMKODUCIION 

Reading pri)l)lcuis have al\sa>s cxibtOLl to va*") ing degrees in the Air ForLe, either as a result of overly 
dilfiLiilt job and training materiali^. or the inadequate reading skills of individual airmen. In response to 
these problems, the Air For^e has pursued two general courses of action. First of all. an attempt has been 
made to sunphfv or niodif\ written materials so that thev are easier to use. such as in the job performance 
aid (JPA) approach (lioehn Si Liimsdame, 195S) The other approach, instead of lowering the difficulty 
level of materials, has attempted to raise the reading skills of individuals to job requisite levels througli 
hteraev training programs. (XkGaff & Harding. 1974. Xto^kovak. 1974a). Despite past efforts Jiowever,« 
leedback from training managers and supervisors indiLates that the reading problem persists. There are 
several possible reasons for this, but the most likely is that poor reading skills remain a common problem in 
those Livilian educational institutions whkh serve as the primarv source of manpower for the Air Force. 
Reading problems are aLo aggravated by the fact that the Air For^e is tasked with the responsibility o* 
training thousands of individuals each year for a myriad of career fitMds which in many cases demand 
sophisticated technical skilli). 

Despite the general LoncurrenLC among training managers tha^ inadequate reading skills are a serious 
problem, and Lon^lusions such as that of the 1^71 and 1074 Air Force World-wide OJT conferences, 
namely, that readuig i-foblems existed which were proving detrimental to the conduct of the on-thejob 
training program, very hitle quantitative information exists concerning the scope and degree of Air Force 
reudmg problems. For example, are reading problems concentrated in those career fields which have low 
entry level requiremenis. or is a greater diversity of career fields affected? Also, are Air Force publications 
such as technical orders (TO), career development courses (CDC), manuals, and resident training materials 
being written for the target population which will bo using them? Finally, how does average reading ability 
vary within the 277 Air Force career ladders, and even more importantly, how does it compare with the 
reading difficulty of material in those ladders'* 

The answers to questions such as these are e^sentlal if rational and viable solutions are to be pursued 
for dealing with existing reading problems Some preliminary steps have been taken, for example. 
Mockovak (1974a) surveyed Air Force reading improvement programs in an attempt ^ > determine. (1) how 
many airmen participated iii reading improvement programs on a yearly basis, (2) v hat the most common 
reading problems encountered among Air Force personnel were, and (3) which career fields contributed the 
largest number of people to reading improvement programs. Howevery no analysis of individual career 
ladders had yet been undertjk<*n to determine ( 1 ) what the reading demands imposed on trainees were, (2) 
how different publications within a given career ladder compared in terms of readability, and (3) how 
reading ability varied within a career ladder.' 

The purpose of this study, therefore, was to address these Kssues and sevc-al related questions in a 
large scale field study encompassing S6 career ladders representative of 35 Air Force career fields. 



II. APPROACH 

One of the major objectives of this study v'<s to obtain an ostirnaie of the reading skill level an 
individual would need in order to be able to rrad and under^t tnt' the training and job materials in his career 
ladder For example, it would be helpful to know if this level were a 10th grade reading level in the cook's 
career specialty, but a 12th grade reading 'evel in an electronic specialist's career area. Unfortunately, 
although numerous tc\hniques or methodologies cxisc for estimating this figure, they are limited by their 
validity and cost (Mockovak, 1974b). 



This was, ' .>yvcvcr, .itcornplishcd for c.uccr fields, sec M.ici-icn and Tiipes (1966) 



For example, the most valid inethodologv tor determining the reading grade level abiln^ a person 
needs to perform batistacK)rily on job reading tasks is the Job Reading Task Test (JRTT) approach 
developed b\ Stielu, Cavlor. Kern, and Fox (1971) Simply, this approach involves the development of a 
job reading task test fur a spetialtv irea which consists of important and frequently performed reading 
tasks from that specialty Individuals of varving reading ability are then tested on the }RT\ in order to 
determine what minimum functional literacy level is required for a specified level of performance on the 
JRTT For example, if the functional literacy level is defined as tliat point at which 80% of the individuals 
are expected to get 70^' o» more of U;c JRTT items correct, and if individuals can be categorized in terms 
of their measured reading grade level (measured by USAFI Achievement Test HI) then that grade level at 
which SO'^'f of the people score 70':T or higher is the functional literacy level. Using tins decision rule, Sticht 
et al found that functional literacy in the Army varied from the 7 to 7.9 reading grade level (RGL) for 
cooks, to 8 to 8 9 for repairmen, and 1 2 to 1 2.9 for supply specialists. Of course, it should be emphasized 
that these functional literacy levels are not absolute. If it was decided that 90% of the individuals should be 
able to read 70'T of the materials, then functional literacy levels would have to be established at a higher 
point 

Although the JRTT approach gives valid estimates of the functional literacy level for a career area, it 
IS extremely time consuming and expensive. Therefore, it was decided that it was not feasible for the 
purposes of this study. In a recent effort, Mockovak ( 1974b) reviewed several methodologies in addition to 
the JRTT approach which could be used to determine the readmg skills and requirements of Air Force 
career ladders. One such methodology was demonstrated in a pilot study, and it produced realistic estimates 
of the reading requirement levels (RRL) and reading ability levels of personnel in 5 disparate technical 
areas Simply described, this methodology relies on the application of a readability formula (FORCAST) to 
tne reading matenal in a career ladder in order to arrive at an overall assessment of the reading reqmrement 
level. The reading grade level of an individual, on the other hand, is estimated from AQE scores through 
regression formulas developed by Madden and Tupes (1966). It was decided tha. chis methodology would 
be utilized in the field study because (1) it was relatively inexpensive, and (2) although somewhat time 
consuming, it could easily be applied by Air Force subject matter specialists in the field without demanding 
any special expertise. Initially, 84 career ladders, representing 42 career fields were to be included in this 
study. These career ladders were chosen to be as representative as possible of Air Force career ladders in 
general, however, this figure was reduced to 56 career ladders, representing 35 career fields due to 
personnel limitations and the inaccessibility of materials in many of the career ladders. Reading 
requirement levels were therefore calculated for only 56 career ladders; however, the sample was stOI large 
enough to adequately represent the spectrum of Air Force career ladders. It was possible, on the other 
liand, to obtain AQE scores for all Air Force career ladders since these data were accesfble in existing 
corr.puter liles. ^ 

Reading Requirement Methodology 

The actual application of the reading requirement methodology was accomplished by Air Force 
snbiect matter specialists (SMS) in each of the 56 career ladders. Each of the SMSs was lesponsible for 
coilecting all of the reading matenals utilized by an airman as he progressed through his career l^ese 
materials were then subdivided into 3 major classifications, ( 1 ) technical training materials (study guides, 
workbooks AFMs, eicj, (2) Career Development Course (CDC) .naterial,(3) and technical orders. After 
collecting all of the relevant reading matenal in a career ladder, the SMS then randomly selected 150 word 
samples from the materials. Depending on the amount of reading material in a career ladder, the actual 
.T^ 1 'fT^* ^'""^ ^^'^ ' ^^^'-^^^"^ 0"^^^ samples had been 

1 t Itl 1 ^ '"'"^'^'^''^ '^'''^ °^^ai" ^'^ ^s^»"^ated grade level 

difficulty. Tlie readability formula utilized in this study was the FORCAST formula which was developed 

Ford 1973). It has been found to correlate .92 and .94 with the Flesch and Dale<^hall readability formulas 
which, m the past, have been the most commonly used formulas. The FORCAST formula, 

Readmg Grade Level = 20 - Number of 1 syllable words 

10 
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prw\uk*s »' liuMlcil iciUMi" umW Icvd ciittkaltv lused un a svlKihle cuunt Iroia a 150 woul sample, for 
example, . * '/RC AS'^ »s used lo cslunale liie readability of a given passage and a lOtli grade level is 
obtained, ic .'iiiically . that iikMns thai at least 50'' of the population with a 10th giade rending level (as 
determined hy VSAV\ .Vhie\emenl Test 111) would be expected to score 35'' correct on a five-cycle clo/e 
icsl of the iiK'tenal (Ca\lor et al . l'>73) A clo/e score of .^5^? corresponds to roughly 70'^; on a multiple 
choice comprehension test of the same material 

Alter calculating the readability of all the samples in Ins career ladder, the SMS placed them m a 
cumulative distribution lab^ *. For purposes of this study, the RRL of a career ladder ^ as defined as that 
pv :«it hchn,' which of the materials were wriiien. The selection of this point was essentially an 
arbitrary decision, siii^ e mor ' or less slnngent levels could have been chosen. Alsu. it should be emphasized 
that the RRL !s a stai .tic il cslimaie of the fun-.tional literal v leveL rather than the type of determmation 
that could be obtaii^ed Using the JRTT approacli. It was not possible within the constraints of this study to 
obtain actual tunctional literacN levels for different career ladders. Moreover, if an individual's reading grade 
level is not equal lo the RRL for his specialty, it does not necessarily mean that he will tail technical 
training, on-tlie job training (OJl). or receive lower evaluations than a counterpart whose reading grade 
level exceeds the RRL Further, due to errors of mcisurement associated with statistical estimation » tins 
methodolog) is not sensitive to individual dil^erences. and therefore, it should not be used with individual 
ainiien However, tor a large sample of mdivi duals and materials it will indicate if :^Mte rials are being 
properly prepared for tne general population which will be using them. 

In summary then, although the RRL is not a direct estimate of the minimum literacy level required 
by an indivulual lo deal with the reading materials m his careei ladder, it is nevertheless a good .i^t /ktj/ 
indicator ot' the level ofliterac\ skilly ^.vxessary One can be relativel> assured that if an indi\idu»d^s reading 
grade level equals or exceeds the RRL. the probability is extremely low that any pert'ormance difficulties 
will be the result of inadequate literacy skills. When used as general indices. RRLs can therefore permit one 
to compare different career ladders m terms of the reading demands imposed on airmen, and even more 
importantly. RRLs of materials can be lontrasted with the reading ability of personnel in order to ascertain 
if materials arc being written for the user population. The presence of a **hterac> gap'M difference between 
RRL and reading ability of personnel) could result in increased training costs and higher I'ailure rates, 
especially if it is excessiveh large. This point will be discussed in detail in a subsetjuent sect.o i. 



III. KiSiJ.IS 

Reliability of Methodology 

A question of paramount concern to individuals using this methodology deal- with its reliabilit> .That 
is. if the procedures for determining the RRL were repeated, would coiiip. - ..ble RRLs be obtained'^ 
Because o( the large number of career ladders inchK'.c.* m this study, it was not feasible to determine the 
RRL a sc^ iiul time, however, it was possible to indirectly a-^ess the reuabilily using the following logic 
which IS somewhat analagous to the split half tcchnuiue of determining test reliability. First ot all. since all 
uf Ihc samples within a career 'adder were random samples, it was assumed that the averages of the odd and 
even numbered samples would each provide an independent estimate of the RRL. (\»rrelating the odd and 
even esiin.ate«^ across the 56 career ladders should therefore provide an estimate of the reliability of the 
methodblogy . Tlus anaUsis was accomplished for all 5o ladders, and a u., bihty t)f f)2 was obtained which 
is quite satisfactory for the purposes of this study. 

Reading Requirement Levels of Materials and Literacy Gaps 

Table 1 (column 2) presents the RRLs determined for each of the 56 career ladders included in this 
study. Once again, the RRL was determined bv combining samples from all publications (TOs, CDCs. etc.) 
and calculating that reading grade level below which 15''( of the samples were written. Across all 56 career 
ladders, the average RRL obtained was a 12.3 reading grade level (standaul deviation - .69). The range 
varied from a low of 10.6 in the 622X0 career ladder (cook), to a higli of 14.0 in the 362X1 ladder 
(telephone switching ecjuipment repairman). 
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/<;/>/( / KcudiiH' Ro<jiiircmcnt Levels 



Career 
Ladder 



Reading 
Rq Level 



Literacy 
Gap 



Average Difficulty 
All Materials 



4:i\i 

46I\0 

^35X0 
605X0 
581X0 
361X4 
SIIXO 
605X1 
^42X0 
362X1 
563X0 
63 1 XO 
547X0 
421X3 
M7X0 
S^IXO 
v5|X0 
8 12X0 A 
552X5 
'432X0 
702X0 
276X0 
363X0 
462X0 
472X1B 
4(MX0 
645X0 
^12X0 
732X0 
705X0 
2^)1X0 
3^)1X0A 
303X2 
622X0 
322X1 
3^) 1 XOB 
651X0 
671X1 
326X1 
204X0 
316X0(; 
328X2 
%5X0 
3(MX4 
751X2 
913X0 
253X0 
902X0 
671X3 
981X0 
5MX0 
982X0 
223X0 
221X0 
252X1 
511X1 



1:4 
134 
127 

128 

12 3 
122 

!27 
12s 

13 1 

14 0 
123 
1:0 
119 
116 
122 
11 7 
11 7 
124 

11 8 
114 

12 2 
13.7 

13 0 
11 7 
1 1 3 

11 7 

12 s 
12.6 
128 

12 5 
128 
124 

13 2 
10,6 
13 0 
124 

12 5 

13 3 
13 0 
12.6 
12 5 
12 6 
12 5 
125 
123 
11 9 
128 
11 8 
126 
II 5 
123 
II 0 
107 
1 1.1 
12.0 
124 



3 3 
3 3 
3 2 
3 I 
3 0 
: 9 

2 9 
2 9 
2.6 



2.3 



2.0 
1.9 
1 9 
1.9 
1 7 
1.5 
1 4 
1 4 
i 3 
1 1 
1.1 
: 1 
1 0 
1 0 
09 
0.7 
07 
06 
0 5 
04 
0.4 
0 3 
0.2 
01 
0 I 
0.1 
00 
00 
+0.2 
+0 2 
+0 4 
+0.4 
+0 7 
+0 9 
+ 1 2 
+ 1.3 
+ 1.4 
+2.1 



4 

:.9 
.5 
4 



10.8 

124 
12 0 
12 1 

11 3 
liJ 

12 i 

1 1 :•: 

1 1 
1: 
II. 
11 
1 1.1 
11.0 
11,5 
10.7 
10.7 

11 5 
11.2 
10.8 
11.2 

12 7 
12.2 
11.1 
10.4 
10.8 
II 6 

11 7 

12 0 
11.2 
12 1 
1 1 4 
12.0 

9.7 
12,2 
11.5 
II 8 
12.4 
11 7 
12.0 
11 8 
12.0 
11.9 
116 
11 6 
11.3 
12.0 
10.9 
11.8 
11.0 
II 5 
10.4 

9 9 
10.4 
II 5 
11.6 



Mean Reading 
Abihty 



9 1 
10 1 
9.5 
9 7 
9,3 
9.3 
9.8 
9.9 
10.5 
1 1.6 
9.9 
9.7 
9.6 
9.3 
10.0 
9,5 
9 5 
10.4 
9.9 
9.S 
103 
12 0 
11.5 
10.3 
9.9 
10,4 
11.4 
11.5 

I 1.7 

I I 5 

I 1 8 

II 5 
:2.5 

9.9 
12.4 
1 1.9 
12.1 
12.9 
12.7 
12.4 
12.4 
12.5 
12.4 
12 5 
12.3 

12 1 

13 0 
12 2 
13.0 
12.2 
13.2 
1 1.2 
12.0 
12.5 

14 I 
14.6 



Note. - Column ) \% the difforomo hotwcoii coUinuis 2 <»iid S. 
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For comparative purposes, it is intereUing to note that recent reading requirement researcli in the 
Army's cook specialty area (Sticht et al.. 1 97 1) has indicated, using the Job Reading Task Test approach, 
that a minimum functional literacy level of 7 to 7.9 is necessary for adequate performance on job readmg 
tasks. Since i* is a tair assumption that cook reading material and job tasks do not differ significantly 
between the Army and Air Force, and that the JRTT approach provides a more valid estimate of a job's 
reading demands, it appears that the RRL of 10.6 obtained using the present methodology overestimates 
the actual functional literacy level needed for adequate job performance. However, in the same study. 
Sticht et aK. report a functional literacy level of 12 to 12.9 for Anny Supply Specialists which compares 
favorably with the RRLs of 12.2 and 12.5 obtained in the Air Force counterparts (647X0 and 645X0. 
respectively). On the basis of these results, it is therefore necessary to interpret RRLs with caution and to 
realize that RRLs were obtained only from job reading materials and that they do not represent 
performance on actual job tasks. Furthermore, the RRL does not take job experience into consideration 
which has been shown to correlate significantly (Vineberg, Sticht. Taylor. & Caylor. 1971) with job 
performance and which indirectly lowers the literacy demands of a job. since a skilled job incumbent does 
not need to refer to reading materials as frequently to perform his work successfully. These limitations are 
not presented to negate the utility of RRLs. on the contrary, they only serve to emphasize that job 
performance is a complex skill which is affected by many different factors. RRLs are a mea,sure of one si ch 
factor but they should only be used to supplement the knowledge and experience of training managers. 

Column 5 of Table I contains the estimated average reading ability of personnel in e ich of the career 
ladders. This figure was compared with column 2 (RRL) to obtain an estimate of the literacy gap (column 
3) existing in each career ladder. Column 4 is simply the average difficulty (50^^ point) of all the materials 
in the career ladder. For comparative purposes, the RRLs for the 56 career ladders were collapsed to obtain 
average RRLs for the .^5 career fields presented in Table 2. In several instances, the RRL for a career field is 
simply the RRL of the career ladder sampled in that field (when only one ladder was sampled from the 
field). If relevant reading requirement data are required concerning a given specialty, the career ladder data 
should be utilized rather^than attempting to generalize from the career field; however. Table 2 enables gross 
comparisons to be made between career fields when reading requirement data are not available for a 
particular ladder. 

Reading AbUity Levels of Personnel 

Mockovak (1974b) compared two procedures for estimating reading grade level from standardized 
test scores such as the Airman Qualifying Examination f AQE) and the Armed Forces Qualification Test 
(AFQT). Neither one of these procedures provides accurate enough estimates to predict individual reading 
abihty . however, when used with large sample sizes, estimates of sufficient accuracy for group comparisons 
can be obtained. On the basis of that study, it was concluded that the Madden and Tupes(l966) AQF 
procedure yielded the most accurate estimates, therefore, it was used to estimate the average reading ability 
of personnel in all Air Force career ladders including the 56 ladders in this effort. Tlie data tor the 56 career 
ladders are presented in Table 3 for two different time frames (1967-1968 versus 1972-1973) and for two 
skill levels as of Jane 1973. The time fiame coTip2n:>on was made to determine what effect, if any. the 
implementation of an all-volunteer military has had on the average reading ability of new accessions. To 
address this question, the AQE scores of Air Force enlistees were collected for the following time periods. 
(I) 1967 -1968 enlistees on duty m June 1969. and (2) 1972-19/3 enlistees on active duty in June 1973. 
This information was collected for the original 84 career ladders, representing 42 career fields, and it 
indicated that average reading abihty did not significantly differ between the two groups. In addition, there 
was no difference between the average reading ability of 3 and 5 skill le\rel personnel for the 1 973 group. 
These results can be misleading, however, because there are significant differences within certain cireer 
ladders. For example, the -t2IX3 career ladder experienced a 2.1 reading grade level drop between June 
1969 and June 1973. whereas, the 571X0 ladder experienced almost a grade level increase for the same 
time frame. Obviously, personnel and training managers interested in these data should concern themselves 
with individual career ladders or career ladders similar in terms of their entry requirements and skill areas. 

Estimates of average reading ability in all 277 Air Force career ladders are presented in Appendix A. 
Estimates of the average readmg ability of personnel in the career fields included in this study are presented 
in Table 4. 
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Table 2. Average Readii ^ Requirement Levels for Career Fields 



Career 
Field 


Reading 
Rq Level 


Literacy 
Gap 


All Materials 


/^vcrage EstimatecS 
R..^ "'tig Ability 


53 


12 J 


-3.2 


12.0 


9.5 


58 


12.3 


-3.0 


11.3 


9.3 


60 


12.8 


3.0 


12.0 


9.8 


42 


12.0 


-^2.8 


10.9 


9.2 


54 


12.5 


2.5 


11.3 


lO.l 


46 


12.6 


2.4 


11.8 


10.2 


56 


12.3 


2.4 


11.5 


9.9 


36 


13.1 




p.l 


10.8 


63 


12.0 


-> > 


1 1.4 


9.7 


57 


11.7 


_ -> -» 


10.7 


9.5 


55 


11.7 


2.1 


11.1 


9.7 


81 


12.6 


2.0 


11,8 


10.6 


43 


11.4 


1.9 


10.8 


9.5 


64 


12.4 


1.7 


11.5 


10.7 


27 


13.7 


1.7 


12.7 


12.0 


70 


12.4 


-1.5 


11.2 


10.9 


47 


1 1.3 


- 1.4 


10.4 


9.9 


40 


II.7 


13 


10.8 


10.4 


73 


12.8 


1.1 


12.0 


11.7 


29 


12.8 


-1.0 


12.1 


1 1 K 


39 


12.4 


-0.7 


11.4 


M.7 


62 


10.6 


-0 7 


0 7 


9.9 


30 


12.9 


-0.4 


11.8 


12.5 


65 


J 2.5 


-0.4 


11.8 


12.1 


32 


12.9 


-0.3 


12.0 


12.5 


20 


12.6 


-0.2 


12.0 


12.4 


31 


12.5 


-0.1 


11.8 


12.4 


67 


13.0 


0 


12.1 


12.9 


lb 


12.3 


0 


11.6 


12.3 


90 


12.2 


+0.2 


11.4 


12.3 


91 


11.9 


+0.2 


11.3 


!2.1 


98 


11.3 


+ 1.0 


10.7 




25 


12.4 


+ 1.2 


11.8 


13.6 


2*^ 


10.9 


+ 1.4 


10.2 


12.3 


T\ 


12.4 


+ 1 6 


11.5 


13 9 


Note.— THb tabic presents the 
discrepancies due to rounding errors. 


s.imc data .is .ittachmcnt 


1 averaged bv career field. 


There are some slight 
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Lihlc S '\\crage Estimated Readini* \bilit> by Career Ladder 



Career 


1967 


—1968 


1972- 


-1973 




-'une 


1973 Data 


















N 


Ladder 


Av RGL 


N 


Av RGL 


N 


3 SK^il 


N 


S SKiM 


:o4\o 


14 : 


47: 


124 


o2 


12 4 




13.0 


.1 


::i\o 


i: " 


1^3 


12 5 


23 


12 0 


4 


1 2 


10 


::3\o 


!:.> 


3 2 


12 0 


50 


12 0 


50 






:5:\! 


14 3 


1.251 


14 1 


1S7 


14 0 


40 


14.2 


141 


:5.>\o 


13 0 








* 


* 










* 


120 


"41 


12 0 


^<)0 


1 1 s 


142 




II 5 


4.1 VI 


1 1 s 


1.050 


1 l.S 


1.3o<s 


1 1.0 


20 1 




12(1 


1 .034 


12 ^ 




12 5 


2<>3 


1 2 0 


10 


.>04\4 


i:o 




12 5 


I.l<s5 


12 5 


1 .020 


1 2 7 


1 50 




13 0 


320 


12 3 


1^)1 


12 3 


1 30 


12.4 


52 




13 0 




12 5 


0^ 


124 


4H 


1 2-0 


21 






SS"' 


124 


42S 


12.4 


35s 


1 2 S 


"^0 






* 


12 " 


137 


12 5 


00 


13 0 




i \4 


5 






51 


0 3 


37 


0 1 


14 




10^) 


44S 


11 5 


30^ 


1 1 4 


310 


1 1 .S 


40 


.^)|\0\ 


* 




1 1 ^ 




i 1 .3 


14 


1 1.7 


8 


^)l\0( 




* 


12 0 


5 


12 3 


4 


1 7 


1 


41)4X0 


11 1 


42 


104 


51 


10 4 


45 


10.2 




4:i\: 


U) 1 


1.354 


\ 


0^1 




533 


0." 


1 5S 


4::\3 


II 4 


- .J ^ 


3 


1 .040 


0 1 


0^1 


0.0 


.^05 


4;.:xo 


I) - 


4/^''5 


*) ^ 


2.2^2 


0 4 


1 .(^04 


0 0 


(^2S 


4<i 1 \o 


II 


3.5 ^2 


10 1 


I.OSl 


100 


S40 


10 5 


232 


4<i:\o 


n 


4.6^2 


10 3 


2.^14 


10 2 


2.004 


10 7 


S20 


4'':\() 


10 1 


24 2 


^) 


4^) 


0» 


42 


o.s 










13 2 


2'!4 


13.0 


101 


13 s 


03 


^1 i\i 


* 


* 


14 0 


Mi 


14 0 


<^() 


14 7 


^\ 


5 v^\0 


10^ 




5 


2S0 


0 3 


ISO 


W 0 


^)7 


342X0 


10" 




10 ^ 


IS" 


10.3 


120 


10.0 


07 


54^X0 


" 


"04 


0 




0 4 


121 


o.s 


iOI 


5^1X0 


1 


.S20 




3X4 


0 3 


105 


0 7 


!S»> 


^^2X^ 


») ^ 


(>()^) 




2 ^ " 


0 M 


152 


10 0 


10^ 


"^d.iXO 


s 


5-12 




140 


^) 


7s 


0 s 


o2 


^"1X0 


^> 1 


1 


100 


1 1.S4 


^) ^) 


0S7 


10 4 


407 


5MX0 


too 


u\ 


3 


"4 


0 1 


20 


04 


4X 


60^X1 


^9 I) 


1 2'*2 


<) 


O'^O 


^) ^ 


32S 


10 2 


30s 


o::xo 


10 4 


2,2(>'' 




S2'' 




"32 


^) <) 




1 xo 


10 0 


2.034 


I) 


"12 


0 0 


52s 


<) s 


IS4 


{14^^X0 


II 5 


o.oos 


1 i 4 


3.60(^ 


11.3 


2 037 


1 1.0 


1 .500 


64^X0 


^> .s 


4 I2^ 


100 


"30 


10 0 


47(, 


10 0 


:of; 


(oiXO 


13 0 


2S<) 


12 1 


147 


12 1 


103 


12 1 


44 


(.^IXI 


i:.s 


4^1 


1 2 ^> 


ISS 


12 S 


120 


13 0 


02 




n : 




13 0 


^4^ 


12 0 


^00 


1 3 .0 


23o 


"o:xo 


10^ 


!u/'2h 


10 3 


4 S4S 


10 2 


3.7^3 


10 ^ 


1 .005 


"0^X0 


i: 1 




1 1 ^ 




1 1 0 


00 


1 1 4 


20 




i i s 
II ^ 


3.3*^^ 


1 1 


L4P) 


1 1 0 


1.0^ I 


1 1 0 


3 OS 


^^1X0 




IHS 


12^ 




124 


2(> 


13 0 


12 


M 1 xo 


10 A 




n s 


^.0^7 


<; S 


3. 4 OS 


10 0 


2.220 


.si:xo 






1 1 ^ 


2.120 


11 4 


000 


11.^ 


1.220 


^)():xo 


i: : 


2 ■^X2 




1.102 


12 2 


7i)X 


12 ^ 


304 


^)05X() 


13 : 


10^ 


124 


1 


12 4 


02 


12.4 




orAo 


Mh 


V, 


12 1 


1 1 


12 


h 


12 0 




*\s|XO 


i: 1 


*Ui3 


1 ^ ^ 




12 1 


3 "^s 


12 ^ 


141 


*>.h:x() 


i: 1 


IIS 


1 ^ "> 


"0 


12 0 


4S 


12 s 




Note. 






l..r Kind 




nru ! 
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Table 4 Average Estimated Reading Ability by Career Field 



Career 
Fteid 


1967 


-1968 


1972 


-1973 




June 1973 


Data 




Av RGL 


N 


Av RGL 


N 


3 SkiM 


N 


5 Skill 


N 


:o 


14.: 




140 


530 


13.3 


412 


13.6 


1 18 


•> > 




185 


12.1 


73 


12 3 


54 


12 5 


19 


23 


11.6 


^97 


120 


134 


11.8 


85 


12.3 


49 


25 


14.4 


1.253 


14 2 


187 


14.0 


46 


14.2 


141 


27 


i: 1 




11.2 


875 


10.4 


583 


1 1.4 


192 


2<) 


1 i 8 


5.192 


11 8 


1 .659 


11.8 


1.3<)8 


11.9 


261 


30 


\i.b 


2.715 


12 5 


1.458 


12.5 


1 .289 


12.8 


169 


31 


13.0 


383 


12.4 


260 


12.4 


187 


12.7 


73 


32 


12.9 


887 


12.5 


565 


12.5 


448 


12 9 


117 


34 


13.0 


87 


12 3 


8 


12.3 


8 






36 


10.8 


663 


1 1.6 


416 


10.4 


353 


10.5 


63 


39 






1 1 7 


27 


11 8 


18 


12.7 


9 


40 


10.7 


92 


10 4 


51 


10.4 


45 


10.2 


6 


42 


1 1.4 


3.687 


1 


1.737 


9.0 


1.184 


9.7 


553 


43 


10.2 


24.439 




9.986 


9.6 


6.776 


10 1 


3.210 


44 


104 


758 


9.7 


460 


9 6 


297 


9.8 


163 


46 


120 


8.204 


106 


3.995 


10 I 


2.943 


10.6 


1.052 


47 


9 9 


1.717 


lO.i 


332 


10.0 


203 


10.0 


129 


51 






13.8 


365 


13.8 


221 


14.3 


144 


53 


10.7 


712 


9.5 


288 


9 7 


191 


9 9 


97 


54 


104 


1.455 


9 9 


409 


9.9 


241 


10.4 


168 


55 


9.3 


1.429 


9.7 


641 


9.6 


347 


9.9 


294 


56 


106 


701 


10.2 


161 


11.16 


84 


1 1.0 


77 


57 


9 1 


1.853 


10.0 


1.184 


9.9 


687 


10.4 


497 


58 


9.8 


510 


9.1 


138 


8.9 


71 


9.4 


67 


60 


9.6 


2.923 


9.7 


1 .538 


9 7 


1.177 


10.1 


361 


61 


1 1 .3 


343 


98 


239 


100 


233 


10.8 


6 


62 


10.4 


2.390 


9.9 


882 


9.8 


782 


9.6 


100 


63 


10.0 


2.034 


9.7 


712 


9.6 


528 


9.8 


184 


64 


109 


10.134 


1 1.2 


4.342 


10.7 


2.513 


10.8 


1,82"^ 


65 


13.0 


289 


12 1 


147 


12.1 


103 


12.1 


44 


67 


13.0 


1.228 


129 


733 


12.9 


435 


13 0 


298 


69 


13.4 


18 


127 


50 


12.6 


32 


13.0 


18 


70 


10.5 


10.961 


103 


4.934 


10.9 


3.813 


11.0 


1.121 


71 


i LI 


119 


100 


45 


9.9 


35 


10.4 


10 


73 


li 8 


3.424 


11 7 


1.520 


11.7 


1.126 


11.7 


394 


74 


1 1 1 
11.1 


All 


1 1 1 
1 1 1 




1 1 


1 /3 


111 
1 1 .2 


146 


75 


128 


230 


123 


149 


12.3 


88 


12.6 


61 


70 






14.0 


167 


13.8 


107 


14.0 


60 


81 


10.8 


15.176 


10.4 


7.826 


10.6 


4.368 


10.8 


3.458 


90 


12.2 


2.887 


12.2 


1.299 


12.3 


890 


12.3 


409 


91 


13 0 


131 


12.9 


81 


12.7 


58 


12.5 


23 


92 


12.9 


159 


13 0 


-) -) 


13.0 


16 


12.8 


6 


98 


12.3 


1.081 


12 2 


569 


12.1 


406 


12.6 


163 
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Readability of Different Publications 

As an airnuui progresses tluoiigli various stages of lus career, lie encounters different publications 
which he nui^t read and understand if he is to be proficient in his job. In technical school, the airman is 
confronted with stud\ guides, vvorkbooks. programmed texts. Air Force manuals, etc , and in certain 
specialties even techmcal orders. On the other hand, an airman in the tleld must study and pass his CDCs m 
order to meet the knowledge requirements for Ins skill upgrading, and, in many cases, he must also closely 
follow the directives of TOs in order to accomplish his job. These various publications impose different 
reading recjuirements on the individual, and therefore, one of the objectives of this study was to compare 
these materials m terms of their readability as measured by the FORCAST formula. Table 5 (column 2) 
presents the average difficulty of reading materials typically used in resident courses. This figure can be 
compared with the a\erage reading abihtv of the personnel in the career ladder (column 3), and with the 
average diffiailtN of all nuterials combined (column 4). Once again, it can be seen that there is a great deal 
of variability in difficulty lexels winch is not entirely content dependent. Tables 6 and 7 present similar 
data for technical orders and CDCs, respe^Mvely, so that it is possible for a given career ladder to compare 
the average difficult) levels of CDCs, TOs, and resident framing materials with each other and with the 
average reading grade level of the personnel 

Table 8 collapses these data across all 56 career ladders and, in general, the data indicate that, on the 
average, technical orders are the most difficult, followed by resident course materials and CDCs. It is 
interesting to note, howexer. that the TOs had the greatest range, from 8.9 to 13.8 (standard deviation = 
l.l). Obviouslv. if an> comparisons are to be made, the data for individual career ladders should be 
compared. 

There are also missing data in Table 8, particularly in the case of TOs, because in many career ladders 
they are not used to any appreciable extent, or are insignificant in number. 

Decision Rules for Determining Literacy Gaps and Readability Specifications 

As previoush stated, one of the objectives of this study was to determine within individual career 
ladders if materials were being written at a difficult) level commensurate with the reading skills of 
individuals in those ladders. A problem arises, however, in determining what a commensurate level is. For 
example, is it necessar) to have 100'; of the peisonnel m a ladder able to read and understand \007r of the 
materiaP That is, operationally defined, none of the difficulty levels of the materials can exceed the reading 
grade level of the worst reader m the ladder. Obviously, this is an extremely conservative and probably 
unnecessary restriction which has interesting implications, since in the 542X0 career ladder, for example, it 
would require that all materials be written at a sixth grade level, or below, which is impractical and 
impossible to achieve. If a 100 -100 decision rule is not practical, then, would a 50 50 rule be applicable'' 
That IS, at least SOVf of the airmen could be expected to read and understand at least 50% of the material 
without any assistance, however, that also implies that S07c of the airmen may have difficulty with at least 
SO^'c of the material 

The problem of determining literacy gaps and specificaiions for individual career ladders, therefore, 
essentially reduces to the operational question of determining what percentage of airmen should be able to 
read and understand a given percentage of the materials in a career ladder. This question is further 
complicated by the obvious fact, however, that an individual does not learn only by reading. For example, 
in technical framing the instriictor gives lectures and performance demonstrations, he provides remedial 
instruction, and he also uses the technical vocabulary associated with the specialty In addition, the airman 
IS surrounded by fellow students who can answer questDns and also serve as surrogate instructors. 
Therefore, in certain specialties, a student may actually have to read and understand very little on his own 
because he is able to acquire the information from other sources. Another factor which also infiuences job 
proficiency is simply experience, that is, the longer a person is on the job the more familiar he becomes 
with standard operating procedures, technical vocabulary, operating directives (TO), etc. Unfortunately, 
however, for those airmen with inadequate reading skills, job experience alone may not be sufficient to 
cope with the demands of CDC courses which must be passed for skill upgrading, as well as studied for 
promotion test purposed Special em|)hasis must therefore be placed on adequate reading skills, since an 
"information overkill'^ situation does not exist on the job, as il does in resident technical training. 
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Tabic 5. Readability Data for Training Manuals 

(SUtdy Guides and ATMs) 



Career 
Ladder 



Averag Difficulty 
Training Manuals 



Mean Reading 
Ability 



Average Difficulty 
All Materials 



361X4 

535X0 

461X0 

605X0 

811X0 

605X1 

432X0 

421X3 

647X0 

563X0 

547X0 

542X0 

421X2 

552X5 

571X0 

551X0 

812X0A 

702X0 

362X1 

276X0 

363X0 

732X0 

812X0 

291X0 

391X0A 

462X0 

622X0 

326X1 

645X0 

391X0B 

705X0 

204X0 

905X0 

404X0 

651X0 

671X1 

316X0G 

221X0 

913X0 

982X0 

328X2 

671X3 

253X0 

304X4 

981X0 

902X0 

511X0 

252X1 

511X1 

Note. 



12.6 

12.2 

12.5 

12 1 

12.1 

12.0 

11 5 

11 : 

!i.8 

11.6 

11.2 

12.0 

10.5 

11.3 

108 

10.8 

11.7 

11.3 

12.5 

12.8 

12.2 

12.4 

12.1 

12.4 

118 

10.6 

10.2 

12.8 

11.4 

11.8 

11.4 

12.0 

12.0 

10.0 

11.5 

12.2 

117 

11.7 

11.3 

10.3 

116 

11.9 

11.9 

114 

11.0 

10.9 

11.6 

11.5 

11.8 



93 
9.5 
10.1 
9.7 
9.8 
9.9 
9.5 
9.3 
10.0 
9.9 
9.6 
10.5 
9.1 
9.9 
9.5 
9.5 
10.4 
10.3 
11.6 
12.0 
11.5 
11.7 
11.5 
11.8 
11.5 
10.3 
9.9 
12.7 
11.4 
11.9 
11.5 
12.4 
12.4 
10.4 
12.1 
12.9 
12.4 
12.5 
12.1 
12.2 
12.5 
13.0 
13.0 
12.5 
12.2 
12.2 
13.2 
14.1 
14.6 



— The career ladders arc ranked in terms of the difference between columns 2 and 3. 



11.1 
12.0 

12.4 
12.1 
12.1 
11.8 
10.8 
11.0 
11.5 
11.5 
11.1 
11.4 
10.8 
11.2 
10.7 
10.7 
11.5 
11.2 
12.9 
12.7 
12.2 
12.0 
11.7 
12.1 
11.4 
11.1 
9.7 
11.7 
11.6 
11.5 
11.2 
12.0 
11.9 
10.8 
11.8 
12.4 
11.8 
10.4 
11.3 
10.4 
12.0 
11 8 
12.0 
11.6 
11.0 
10.9 
11.5 
11.5 
11.6 



ERLC 



14 

18 



Table 6. Readability of Technical Training Materials 



Range 



All Reading Matorials 
Career Dev. Courses 
Teclmical Orders 
Training Manuals 
(Study Guides & AFMs) 



Median 


Mean 


so 




High 


N 


11 5 


11.5* 


.64 




12.9 


56 


11 3 


11.:* 


.73 


9 3 


13.2 


54 


i: 1* 


11.8 


1.1 


8 9 


13.8 


28 


11.8 


11 7* 


.64 


10.0 


128 


51 



♦ Best estimate based on distribution. 



Table 7. Readability Data for Technical Orders 



Career 
Ladder 



462X0 

421X2 

535X0 

563X0 

461X0 

631X0 

581X0 

647X0 

276X0 

421X3 

362X1 

361X4 

605X1 

472X1B 

645X0 

432X0 

36iX0 

551X0 

571X0 

404X0 

322X1 

651X0 

316X0G 

328X2 

304X4 

542X0 

303X2 

326X1 



Average Difficulty 
Technical Orders 



13.8 

12.4 
12.1 
12.5 
125 
12.0 
11.5 

13.8 
1 1.1 
13.3 
10.8 
11.2 
11.1 
12.5 
i06 
126 
10.5 
10.5 
109 
125 
12.0 
123 
12.1 
12.1 
8.9 
11.5 
11.7 



Mean Reading 
Ability 



Average Difficulty 
AU Materials 



10.3 
9.1 
9.5 
9.9 
10.1 
9.7 
9.3 
10.0 
12.0 
9.3 
11.6 
9.3 
9.9 
9.9 
11.4 
9.5 
11.5 
9.5 
9.5 
10.4 
12.4 
12.1 
12.4 
12.5 
12.5 
10.5 
12.5 
12.7 



11.1 

10.8 

12.0 

11.5 

124 

11.4 

11.3 

11 5 

1J7 

!1.0 

.2.9 

11.1 

11 8 

10.4 

11.6 

10.8 

10.7 
10.7 
108 
12.2 
'1.8 
11.8 
12.0 
1 1.6 
11.4 
12.0 
11.7 



Noto. -C^fccf ladders arc ranked in terms of differences between columns 2 and 3. Not all career ladders use TOs 
to a significant cKtent, therefore, only 28 ladders arc represented in this table. 
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Tabic 8. Readability Dat? for Career Development Courses 



Career 


Average Difficulty 


Mean Reading 


Average Difficulty 


Ladder 


Career Dev Courses 


Ability 


All Materials 


8 1 1 XO 


1 1 4 


O Q 
V.O 


12.1 


542X0 


1 1 8 
1 ^.0 


lU.J 


1 1.4 


605X0 


1 1 Q 


Q 7 


12.1 


421X3 


1 1 1 
1 1 .J 


Q ^ 


1 1.0 


36 1 X4 


1 1 1 
11.1 


Q 7 

y.o 


1 1.1 


421X2 


1 0 S 
1 u.o 


Q 1 


10.8 


362X1 


1 1 1 


1 1 ^ 

1 1 .o 


1 2.9 


5535X0 


1 1 1 

11.1 


Q ^ 


12.0 


461X0 


1 1 A 
1 1 .o 


1 n 1 

lU.l 


1 2.4 


605X1 


1 1 1 


Q Q 
V.V 


1 1 .0 


631X0 


1 1 0 


Q 7 


1 1.4 


547X0 


10 S 


O A 
V.O 


1 1.1 


552X5 


1 1 0 
1 1 .U 


y.y 


1 1.2 


551X0 


10 4 


Q ^ 


10.7 


563X0 


10.8 


Q Q 


1 1 .D 


571X0 


10 4 


Q S 

V.J 


10.7 


647X0 


1 0 0 
iv.y 


1 n n 
lU.U 


1 1.5 


702X0 


1 1 1 
11.1 


1 n 7 


1 1.2 


432X0 


10 ^ 
lU.J 


v.D 


10.8 


812X0A 


1 1 0 
1 1 .u 


1U.4 


11. 5 


462X0 


1 0 Q 
1 U.V 


lU.J 


1 1.1 




1 7 Ci 


lie 


12.2 


404X0 


1 0 7 


1U.4 


10.8 


47')Y 1 R 
t / A 1 D 


lU.U 


9.9 


10.4 




1 1 /I 
1 1 .4 


1 1 y| 

1 1 .4 


1 1.6 




1 7 7 
1 /.z 


12.4 


12.2 


AS 1 XO 


1 1 Q 
1 1 .0 


12.1 


1 1.8 




1 1 c 


1 1 o 

1 1.8 


12.1 




1 1.2, 


12.5 


12.0 


1 Xl 

O / 1 A 1 


1 7 C 


12.9 


12.4 


70SX0 


1 1 n 
1 1 .U 


1 1 c 

1 1 .5 


1 1.2 


R \ 1X0 

O 1 AU 


1 1 rt 
1 1 .U 


lie 
1 1 .3 


1 1.7 




1 1 fi 
1 l.o 


12.4 


1 1.9 


AUXO 


V.J 


9.9 


9.7 


1 1 Axon 

0 1 D AUO 


1 1 Q 

1 l.o 


12.4 


1 1.8 


104X0 


1 1 fi 
1 1 O 


12.4 


12.0 


'^78X0 


1 1 ^ 
1 1.J 


1 A 

12.0 


12.7 


75 1X2 


1 1 A 
1 1 .0 


1 2.J 


1 1.6 


782X0 


10 S 


17 1 


104 


253X0 




1 7 n 

1 J.U 


12.0 


104X4 


1 1 A 
1 1 .0 


lie 


1 1.6 


391 XOA 


10 S 


1 1 s 
1 1 .D 


1 1.4 


732X0 


10 A 


1 1 7 
11./ 


1 'I A 

1 2.U 


981X0 


1 1 0 
1 1 .u 


Ill 
1 1.1 


1 1.0 


328X2 


11.3 


12.5 


12.0 


J91 aUB 


10.5 


11.9 


11.5 


671X3 


11.5 


13.0 


11.8 


326X1 


11.1 


12.7 


11.7 


511X0 


11.4 


13-2 


11.5 


223X0 


9.9 


12.0 


9.92 


221X0 


10.2 


12.5 


10.4 


252X1 


11.4 


14.1 


11.5 


511X1 


11.4 


14.6 


11.6 



Note. — Career ladders are ranked in ternis of che difference between columns 2 and 3. 
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From the preceding discussion, it should be obvious tiiat the use of a decision rule to determine a 
literacy gap is not a straightforward matter. For example, if a 2 grade level difference is found between the 
reading requirement level and the reading ability level of the students, what in fact does that mean in terms 
of training costs student failure ratcb. student attitudes, etc/' As mteresting as this question is, it could not 
be addressed in ^his study because of. (1) a lack of adequate measures of cost and performance factors, and 
(2) the methodological problems associated with determining the lelativc contribution of reading ability to 
job performance. Without an answer to the preceding question, however, the establishment of a decision 
rule becomes essentially an arbitrary decision based on expert opinion and, hopefully, soand experience. It 
IS important to emphasize, however, that guidelines of some sort are necessary if only to increase the 
awareness of Air Force technical writers to an important educational characteristic of their user population. 
For example, Sticht, Caylor, Kern, and Fox (1971) discovered that if written materials are too difficuUv 
there is a tendency for individuals not to use them. .\lso. of special importance, is the finding that for poor 
readers the frequency of listening to obtain job information, relative to reading, was higher in those job 
areas with more difficult materials. The implication of these results is simply that as the gap widens 
between the reading ability of an individual and the reading requirements of hu job, the individual must 
seek access to other sources of information if he is going to be able to acquire those job knowledges 
necessary for successful performance and skill upgrading. There should, therefore, be a concerted effort to 
insure that materials are presented in as clear and concise a manner as possible, and in order to accomplish 
this, guidehnes such as AFP \ 3'2yGuide for Air Force Writing, are necessary. 

In this study. 4 different decision rules were compared to determine "literacy gaps." The gaps 
resulting from these 4 decision rules were collapsed across all 56 career ladders and the results are presented 
in Table 9. To reiterate, a 75-50 rule, for example, means that an "average" individual in a 'adder should 
be capable of reading and understanding 75';^ of the reading material he encounters without any assistance. 
It is obvious from the table that as a decision rule becomes more stringent, the resulting literacy gap 
increases in size, therefore, the perceived mismatch between men and materials appears worse when actually 
the same career ladders are being described. Unfortunately, what can operationally be defined as a 
"criticaP' gap under each of the decision rules, that is. where performance and training problems can be 
expected, has not yet been experimentally determined. 



Table Literacy Gaps Resulting 
*som Different Decision Rules 



Decision 
Rule 


Medlar 


Mean 


SD 


Range 

Low 


High 


N 


50-50 


- .3* 


- 2 


1.4 


--2.5 


3.0 


54 


75-50 


-1.1 


-1.1 


1.4 


-3.3 


2,2 


56 


50-85 


-1.6* 


-1.5 


1.5 


-4.0 


2.4 


54 


75-85 


-2,5 


-2.3 


1.6 


-4.8 


1.6 


54 



*Best estimate based on distnbution. 



For the purposes of this study, the 75-50 decision rule was utilized as a measure of the mismatch 
between men and materials because it offered an acceptable alternative to the extremes of 50-50 and 
75-85. The resulting literacy gaps are presented in Tables 1 and 2 and it is interesting to note that those 
career ladders with the lower average reading grade levels (personnel) do not necessarily have the lower 
reading requirement levels. 

it is also interesting to note what happens when the 75-50 decision rule r applied to career fields 
with known reading problems. For example, in a previous study, Mockovak (1974c) \(\on*ir^p^ \o career 
fields which accounted for approximately 84% of the enrollment in base reading improvement programs. 
The hteracy gaps in these fields using the 75-50 rule are presented in Table 10. The average literacy gap for 
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Table 10. Literacy Gaps in 10 
Career Fields with Reading Problems 



Career Field 


Average Literacy (iap 


Range of Average 
Reading Ability 


60 • 


-3.0 


9.0- 10.7 


42 


-2.8 


8.7 - II. I 


54 


2 S 


9.4 - ! 1.3 


63 


-2.3 


9.9 


55 


-2 1 


8 0-- 12.5 


81 


-2.0 


lO.O ~- 1 1.4 


43 


- 1.9 


8.6 - 10.5 


64 


1.7 


9.9 - 12.0 


70 


- 1.5 


10.3 - 12.1 


62 


-0.7 


9.8 - 1 1 .0 


Average 


-2.1 





the 10 tieidb is 2.1 which is a lull grade level more than the average for all 56 ladders of-1 1 (Table 8) In 
fact only one career field (62) does not exceed this average. Therefore, it appears auite reasonable that 
overly difficult reading materials may be contributing to the reading problems of these personnel, although 
the ranges (column 3) of average reading ability for the 10 fields are also quite low, which suggests that 
some reading prublems would exist despite the readability of the materials. 

K final question which was of concern in this study concerned the establishment of readability 
specifications for Air Force career ladders, that is. what grade level difficulty should Air Force technical 
writers attempt to achieve. Although the 75-50 decision rule could have been utilized to determine this 
figure. It was decided to use the 50-85. instead, because it would be somewhat ea.ier for Air Force writers 
to arnve at an average difficulty level, rather than a 75"^ point. Simply, the 50-85 rule implies that the 
average difficulty of the material should not exceed the reading ability of 85% of the people in a ladder 
This figure was calculated for the 56 career ladders, and it is presented as the "ideaP' readability 
specification ,n Table 1 1 . column 2 (also, column 4, Appendix A). It is considered "ideal" because in many 
cases It ,s too low to be practically achieved. For example, the 361X4 ladder would require an average 
difficulty of 7.7 (estimated by FORCAST) which is. fo, all practical purposes, quite unrealistic, a fact 
which anyone who has attempted to write to those levels will readily acknowledge. Therefore Table II 
(column 3) also contains a recommended difficulty level which should be more practically attainable It 
may appear that the range presented ,s too restricted but actually it has the advantage of providing the Air 
Force technical writer with a great deal of ficxibiiity since he would then be able to vary his style based on 
the content of his material. For example, if a simple procedure is being described, an 8th grade level 
difficulty would be appropriate, however, if the discussion involves nuclear fusion, then a 1 2th grade level 
would probably be more suitable. The important consideration,, and the value of column 2 is that the 
technical writer is made aware of an important educational characteiistic of his intended audience. 

As a concluding remark concerning the c omplex problem of establishing readability specifications it 
IS a foregone conclusion that a literacy gap will exist for a certain percentage of personnel in almost every 
career ladder. In the majority of career ladders, however, it appears that supplements to reading such ns 
inst.uctor lectures, remedial sessions, audio-visual aids, fellow airmen, performance demonstrations etc 
will be sunicient to insure that the trainee acquires necessary job information. Nonetheless there will be 
cases where the literacy gap is so severe that these additional sources of information will not be adequate 
for the .ow ability reader; therefore, training and job performance problems will result and solutions to 
these prohlcnis must be found. 
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Table II Readability Specifications 
for Career Ladders 



Career 
Ladder 


ideal Average 
Difficulty Level 


Recommended Average 
Difficulty Level 




1 1 A 

1 1 .4 


1 1 A 

1 1 .4 


221X0 


1 1.3 


111 
1 1 .3 


223X0 


10.2 


1 A C 

1 u.^ 


252X1 


12.9 


1 A 

1 2.U 


253X0 


12.8 


1 A 

1 2.0 


27dXU 


1 1 .0 


1 1 c\ 
1 1 .U 


29 1 XO 


10.2 


1 A C 
1 U.J 


303X2 


lie 
1 1 .5 


1 1 .J 


304X4 


1 1 c 
1 1 .0 


1 1 ^ 
1 1 .J 


3 16X00 


1 1 c 
1 1 .D 


1 1 .J 


32X1 


1 1 .4 


1 1 A 

1 1 .4 


326A1 


1 1 c 

1 1 .6 


1 1 A 
1 1 .0 


32oX2 


1 1 c 

1 \.o 


1 1 ^ 
1 1 .J 


30 1 A4 


1 1 
f . / 


1 n s 

1 U.D 


362X1 






3o3XU 


lU. J 


1 U J 


3V I XUA 


lU.V 


1 u.v 


3vl aUc 


lU.V 




4U4X0 


O A 


1 U.J 


421X2 


7.6 


lU. J 


421X3 


7.6 


1 A C 
1 U.J 


432X0 


O A 

o.O 


lU. J 


461X0 


0.7 


lU. J 


462X0 


O.O 


1 U.J 


472X1B 


O A 

O.O 


lU.j 


51 IXO 


1 1 A 

1 1 .9 


I 1 o 

I I .y 


51 1X1 


14.0 


1 O A 

1 2.U 


5535X0 


8.0 


1 A C 
1 U.J 


542X0 


O A 

8.9 


1 A C 
lU.J 


547X0 


8.0 


1 A C 
lU.J 


551X0 


7.9 


1 A C 
lU.J 


552X5 


8.5 


10.5 


563X0 


8.2 


10.5 


571X0 


8.6 


10.5 


581X0 


8.0 


1 Ti C 

lO.j 


605X0 


8.7 


1 A C 

10.5 


605X1 


8.7 


10.5 


622X0 


8.5 


1 A C 

10.5 


631X0 


8.3 


1 A C 

10.5 


645X0 


10.2 


1 A C 

10.5 


647X0 


O f 

8.6 


1 A C 

lU.j 


651X0 


1 1 A 

1 1 .0 


1 1 A 
1 1 .U 


671X1 


1 1 A 

1 1 .9 


1 1 o 

1 1 .9 


671X3 


12.1 


1 O A 

1 2.U 


702X0 


Q Q 
O.O 


1 U.J 


705X0 


1 A O 

10.2 


lU.j 


/32AU 


lU.J 


1 U.J 


751X2 


11.2 


11.2 


811X0 


8.6 


10.5 


812X0 


9.7 


10.5 


812X0A 


9.7 


10.5 


902X0 


11.0 


11.0 


905X0 


11.3 


11.3 


913X0 


11.1 


11.1 


981X0 


11.1 


11.1 


982X0 


11.0 


11.0 



*Data not available. 
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IV. CONCLUSIONS AND RECOMMENDATIONS 



On the basis of the data obtained m this study, it appears that meaningful discussions of Air Force 
reading problems should be directed towards individual career ladders or fields, but not the training 
environment as a whole The variability in both reading skills and requirements between career ladders 
emphasizes the necessity for isolating reading problems, as well as their causes, since m everv situation the 
causes will not be the same. For instance in the 432X0 career ladder, one obvious cause of reading problems 
is the low average reading ability of the personnel (9.5). Howeverv the average difficulty level of resident 
training materials is 1 1.5 (Table 4) which aggravates the situation. On the other hand, m the 421 X2 ladder 
the personnel hav: an even lower average reading grade level of 9.1, but their most difficult reading 
materials are technical orders, which have an average readability level of 12.4 (Table 6). In both of these 
examples, marginal reading skills can be expected to cause problems, but the situation is aggravated by 
overly difficult job reading materials. 

It IS also interesting to note that the 421X2 ladder has a RRLof 12.4 which is identical to the RRL 
in the 511X1 ladder. However the average reading ability level of the personnel in the 511X1 ladder is 
14.6. Therefore, even ihougli the average reading ability of personnel in the 421X2 ladder is more than 5 
grade levels lower than the reading abUity of personnel in the 511X1 ladder, airmen in both ladders are 
faced with reading materials which requiie approximately the same literacy skills. Obviously, reading 
materials are not being written to the literacy level of the user, and as shown in Figure 1 , this appears to be 
true across the 56 ladders sampled in this study. 

Figure 1 shows how RRLs vary across a range of reading ability for different Air Force career ladders. 
If materials were being written for the intended user, a monotonic relationship could be expected, that is, 
as reading ability levels drop, the RRLs should also drop. Obviously, this is not the case, and it is a situation 
which should not be allowed to persist. 

One solution to the problem of overly difficult job reading materials is material modification which is 
an expensive, labonous, and time consuming process. It appears that major benefits from this approach 
could be expected in those areas which have large literacy gaps, and generally, personnel with low average 
reading levels It also appears that material modification should have a significant favorable impact on OJT, 
where the uidiviJual is almost totally dependent on his own reading ability for obtaining job relevant 
information. It should be emphasized that matenal modification does not refer solely to the rewriting or 
reformatting of relevant job information, such as in the JPA approach (Folley & Munger, 1961). Instead, 
other means of supplementing the textual matenal are also included, such as audio supplementation 
(Sellman, 1970). 

Since reading is only one means of obtaining job information, it appears that in certain circumstances, 
that is, where average reading ability is extremely low, a massive redesign of the training environment may 
be iustified Such an approach has been demonstrated in Automated Apprenticeship Training (AAT) 
fPieper. Catrow, Swezey, & Smith, 1973) which utilizes audio-visual materials to replace much of the 
wntten material m a course. Essentially, therefore, the literacy demands of training a'e reduced by doing 
away with much of tb^ rending in a course. The AAT approach has been successfully demonstrated m the 
Air Force Security Police Law Enforcement and Security Specialists career ladders, and its concepts offer 
potential benefits in both resident and on-the-job training. 

The final alternative for dealing with inadequate reading skills is one with which the Air Force has 
had a certain amount of experience. Literacy training, or reading improveiricnt courses, have been in 
existence on a large scale basis since the mid 1960s, however, despite their relatively high costs, their overall 
benefits have been somewhat questionable (Mockovak. 1974c). There are many possible reasons for the 
limited effectiveness of literacy training efforts, but the most likely reason is that they employ essentially 
the same training techniques which have already proven incifective for problem readers during 12 years of 
prior schooling. In addition, many Air Force reading improvement programs in botli basic training and out 
in the field are quite short in duration, and appear to have unrealistically low graduation goals in terms of 
the reading requirements found to exist in Air Force specialties. Probably the most serious problem 
encountered, however, involves the motivation of individuals exposed to reading improvement courses. 
Besides the resentment at being placed in such courses, participants must also bear the stigma attached to 
anyone associated with "remedial'* programs. Supervisors tend also to resent the courses because they keep 
scarce manpower from performing a variety of necessary functions, and the trainees themselves must 
conrinually deal with the labels of inadequacy so often attached to course participants. 
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In liglit of these consulerations. it appears necessary that a new philosophy of reading training be 
implemented in the Air Force, especially with respect to the unique problems associated with adult 
education Such :i philosophy has been suggested and is currently boing demonstrated in an operational 
program at Ft Ord, Cahforma (Stuht. 1973) The approach has been referred to as Job-Specific Literacy 
Training or JohOriented Reading Training, and basically, it involves training directed towards improving 
those skills associated with the performance of job reading tasks, Utih/.ing such an approach, course 
materials consist ahiioM entirely of job-related reading materials. In fact, actual publications from related 
career ladders may be used as instructional material. The reading skills in which an individual miglit receive 
training include, but are not limited to, such skills as the use of indexes, following procedural directions, 
extracting intormation from job manuals, locating job-related infomiation, and technical vocabulary 
training. Fmpirical support for this approach has been provided by Sticht and Caylor (1973) who compared 
the perfomiance of 2 groups of low-ability readers (5th RGL) on a Job Reading Task Test (JRTT), Of the 2 
groups, one consisted entirely of new Army recruits, whereas, the second consisted of men who had 
previously undergone 8 weeks of job trainmgin the areas represented by the JRTTs. Although both groups 
of men had the same reading ability level, the job-trained men performed significantly better on the JRTTs 
in 3 Army occupational specialties. This study indicates that job training can result in the improvement of 
certain job-related reading skills, while leaving ''general" comprehension skills as measured by standardized 
reading tests, unaffected. 

If. as the avail:ible research oviJence suggests, it is possible W selectively improve job-related reading 
skills througli a job-oriented reading improvement program, then one of the major problems facing existing 
Air Force reading improvement programs could be dealt with. Simply, ^'remedial" reading witn all its 
negative connotations could be replaced by supplementary job reading training which carries no stigina 
whatever since the participant is actually training for his Air Force job. This would be especially true it the 
job-oriented reading training could be enclosed in self-contained modules which the student could proceed 
througli at his own rate. Actually, reading improvement training could be divided into two phases. The first,, 
job-oricnted reading training, could be concerned with the improvement of job-related reading skills so that 
the individual would have the skills necessary for successful performance in OJT and on-the-job. A second 
phase, career reading improvement,, could be concerned with the development of more general 
"comprehension'* skills, and this phase could be much longer in duration, and having as one of its general 
goals a certain increase in an aimian's scores on standardized reading measures. Based on available evidence 
(Mockovak. !974a). it appears that this secottd phase of reading training could best be accomplished 
through Veteran\ Administration (VA) funded programs arranged through base education offices. These 
programs would be entirely voluntary and could be terminated by the student at any time. VA funded 
programs are considered to be a viable alternative because sufficient money exists to attract qualitied 
instructors familiar with adult reading problems In addition^the airman's involvement in a VA program 
would also bring him into contact with other VA supported educational opportunities, therefore, the 
impetus may exist for the airman to continue his other career-oriented educational efforts. It is e^jpecially 
miportant to emphasi/e, however, that although the job-oriented reading training would be mandatory, it 
should not be referred to as "reading traiiMng" because its function would not be to replace general reading 
improvement traming which is moie long-tcfm in nature (Phase 11) and which should be conducted on a 
more voluntary basis Practical experience has shown quite clearly that attempting to force a person to read 
IS nc only expensive and time consuming, it is also a wasted effort in the vast majority of cases. 

The two phases of the suggested reading training program address 2 different sets of reading skills, but 
the key to success in either case is motivation. In Phase I, th^^ motivation should result from an individuaFs 
involvement in his career specialty and his training for that specialty. In Phase 11, the motivation must 
ultimately come from the individual himself and a desire on his part for self-improvement. A case in point 
concerns one voluntary enrollee in a base reading improvement program. This individual enrolled in the 
program because he wanted to read stones to his small child. Obviously, if the Air Force could generate 
similar enthusiasm in other individuals with poor reading skills, a great many reading problem: rould be 
resolved. 
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From the preceding discussion LonLeming pobsible boluiionb tu (lie Atr I-orce's readini; problems, it 
appears obvious that an\ overall plan of action will rei]iiire s\:>tenutK\ diverse, long-term solutions which 
are well Loordinated between the \ariou^ PUjoi commands. The purpose of the present studv Jum ever, was 
not ;o demonstrate a solution, but rather to demonstrate a methodolouv which Lould be u.ed to determine 
the reading requirements miposed on Air ForLC personnel as thev advanced through their Air F-orce careers. 
In addition, a relat.'d goal was to provide reliable estmiates of the reading abilitv of personnel in different 
career ladders in order to establish rea'as^^L readabibtv spcLifications that could be used bv both civilian and 
military technical writers in the preparation of training materials 

On the basis of the results obtained in this study, it appears that the Air Force has significant literacy 
gaps in a number of career ladders. H»>v,evvr. as was mentioned previonsl> . a htoracy gap of some extent 
will almost always exist for a certain perccntu^ie of individuals in any given career ladder. It should be 
emphasized that a literacy gap. per sc. may not become a problem anless the additional burden placed on 
the training system is so severe th.it the system cai.not cope vvidi it. This situation has occurred more 
frequently in OJT than resident training ^implv because resident training courses are better equipped in 
temis of resources and personnel to provide supplemental sources of information to problem readers. At 
any rate, it is probably a fair assumpMon to say that literacy gaps reduce training effectiveness, and 
indirectly, if not directly . increase the costs associated with educating and training Air Force manpower- 
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.•\PPE\DIX A 

listimated Average Reading Grade Level 
of US.AP Personnel by Career Ladder 
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Population Description - IJSAP Hnlistod Personnel 
(5 skill level and below) on Active Duty as of March 1974 



AFSC 


\ 


Average Reading 
Grade Level 


Reduced Reading* 
Grade Level 


200X0 


1 


15.0 


15.0 


202X0 


1426 


14.2 


15.2 


203X0 


52 


14.2 


12.5 


205X1 


1954 


14.4 


15.6 


204X0 


571 


12.8 


11.6 


205X0 


501 


14.5 


15.6 


206X0 


557 


14.2 


15.0 


207Xi 


1929 


12.0 


10.8 


207X2 


994 


12.0 


10.8 


221X0 


188 


12.5 


11.5 


222X0 


62 


12.8 


11.6 


222X1 


39 


12.9 


11.8 


223X0 


119 


12.1 


10.4 


225X1 


472 


12.1 


10.4 


250X0 


5 


10.6 


9.9 


255X2 


125 


11.1 


8.8 


255X4 


556 


11.4 


9.2 


254X0 


277 


12.4 


11.2 


255X0 


27 


12.1 


10.6 


235X1 


5 


14.2 


15.8 


256X0 


65 


12.0 


10.0 


256X1 


524 


11.6 


9.4 


257X0 


26 


11.4 


8.9 


257X1 


17 


10.4 


8.7 


241X0 


45 


12.5 


11.1 


242X0 


24 


12.4 


11.4 


250X0 


6 


14.1 


12.9 


252X1 


1204 


14.5 


15.4 


255X0 


20 


14.2 


13.0 


270X0 


11 


12.5 


11.5 


271X0 


1568 


10.6 


8.9 


'>7'>\r\ 


ZUOO 


12 . 4 


11.2 


274X0 


478 


12.2 


11.0 


276X0 


2495 


11.9 


11.0 


276X1 


24 


12.0 


11.0 


290X0 


1 


10.0 


10.0 


291X0 


5558 


11.5 


9.7 


293X3 


1074 


11.7 


10.5 


295X0 


109 


12.0 


11.2 


296X0 


3 


12.5 


12.0 


300X0 


7 


12.5 


11.6 



* One standard deviation below mean 
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Average Reading Reduced Reading* 
AFSC N Grade Level Grade Level 



302X0 


618 


12.6 


11.6 


502X1 


34 


12.6 


11 .8 


303X1 


874 


12.4 


11.4 


303X2 


1594 


12.4 


11.3 


505X3 


695 


12.4 


n .3 


504X0 


2063 


12.4 


11.3 


304X1 


592 


12.5 


11 .4 


304X4 


4096 


12.4 


11.3 


304X5 


138 


12. 1 


10.6 


304X6 


68 


12.2 


11.0 


305X4 


1582 


12.5 


11.4 


506X0 


1361 


12.6 


11.6 


306X1 


396 


12.7 


11.8 


507X0 


1193 


12.5 


11.4 


308X0 


17 


12.8 


11.8 


309X0 


38 


12.2 


11.1 


510X0 


14 


U.8 


10.8 


316X0 


2020 


12.4 


11.3 


316X1 


779 


12.4 


11.4 


316X2 


258 


12.5 


11.4 


317X0 


445 


12.6 


11.5 


320X0 


12 


11.6 


10.1 


321X0 


462 


12.5 


11 .5 


522X1 


1785 


12.5 


11.5 


323X0 


366 


12.6 


11.5 


324X0 


1563 


12.8 


11.9 


325X0 


942 


12.4 


11.4 


525n 


1435 


12.4 


11 .2 


326X0 


155 


12.5 


11.4 


326X1 


473 


12.6 


11.6 


326X2 


690 


12.4 


11.3 


327X0 


212 


12.4 


11.4 


528X0 


1537 


12.5 


11.3 


328X1 


1348 


12.5 


11 .2 


528X2 


129 


12. 2 


11.0 


328X3 


1288 


12.4 


11.4 


328X4 


1024 


12.4 


11.3 


529X0 


369 


12.5 


11.3 


340X0 


3 


12.6 


11. 5 


341X1 


123 


12.6 


11.5 


342X0 


361 


12.7 


11.7 


342X1 


52 


12.5 


11.4 


543X0 


129 


12.6 


11.6 


344X0 


41 


12.0 


10.9 


345X0 


20 


12.7 


11.8 



* One standard deviation below mean 
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Average Reading 
AFSC N Grade Level 



3b0X0 3 11.1 

361X0 621 9.3 

361X3 128 9.3 

361X4 449 9.5 

362X1 707 nil 

362X2 151 12.0 

362X3 81 11.2 

362X4 592 10.5 

363X0 1289 11 4 

390X0 1 12 3 

391X0 449 v'l 

400X0 5 10 '.8 

403X0 54 11 9 

404X0 216 11.0 

404X1 95 11.3 

420X0 23 8 7 

421X1 375 9.4 

421X2 1989 9 i 

421X5 4315 9 7 

422X0 97 10.6 

422X1 1077 9.3 

422X2 684 9.9 

425X0 2040 10 2 

424X0 1118 9 0 

424X1 170 9.3 

425X0 277 11. l 

450X0 63 8.6 

431X0 999 10.5 

451X1 24844 9 9 

452X0 6591 9.6 

452X1 424 9.8 

455X0 214 10.1 

455X0 12 10.5 

440X0 6 9.0 

442X0 59 10! 5 

445X0 1295 10 0 

460X0 1 12.1 

461X0 2899 10*5 

462X0 8245 10 5 

465X0 1055 12.7 

464X0 49 11 4 

470X0 4 8 2 

472X0 410 9'g 

472X1 845 9 5 

475X0 1585 10. 0 



* Oiie standard deviation below mean 



Reduced Reading* 
Grade Level 



9.5 
7.8 
7.7 
7.8 
9.7 
10.7 
9.9 
9.1 
10.1 
12.5 
11.0 
9.5 
10.6 
9.5 
9.9 
7.4 
7.9 
7.6 
7.9 
9.2 
7.8 
8.5 
S.5 
7.7 
7.8 
9.6 
7.5 
8.9 
8.4 
8.0 
8.2 
8.6 
9.5 
8.2 
8.8 
8.4 
12.1 
9.0 
8.9 
11.7 
10.0 
6.5 
8.0 
7.8 
P.. 2 
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Average Reading Reduced Reading* 
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uracie i.evei 
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.:>Ub 
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I / OU 
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4 14 
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1 s 0 
i J . u 
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r 
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in 1 


Q 0 




4b / 
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O . D 




Ann 


y . b 


7 Q 




1 OA 


y . b 
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/ . / 


bb4XU 


2ub2 


Q A 

y .0 


o . JL 


b.:)bAlJ 


y4b 


y . / 


ft 0 


bxiXU 


T 1 '7 

j4/ 


11 1 

ii . 2 


y . b 


r 1 n V* A 

540X0 


p 

5 


11 

i i . 2 


0 


r 1 1 vn 

d41XU 


1 A 1 

4o4 


11 7 


y . D 


:)4JXU 


1 1 7 O 
11. ">b 


in Q 


y . ^ 


54JX1 


44b 


in 7 


o n 
y . u 


b4:)X0 


2uiy 


0 7 

y . / 




544XU 


9 ')A 

226 


O Q 

y . 0 


ft 4 
o . 4 


545X0 


1216 


in A 
lU . 4 


o . 0 


540X0 


"An 


in '? 
lU . 2 


ft c 

0 . b 


:d47X0 


1 0 A 1 

1 261 


O /I 

y .4 


7 7 


550X0 


1 


o n 


ft n 
o . U 
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1 /' A/I 

1606 


n 0 

y . 2 


7 A 
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1 T Ail 

L^06 


n /I 

y .4 


7 ft 


552X0 


1 ,1 7 A 


n 7 

y . / 


o . U 


552X^ 


.:>41 


n > 

y . z 


7 A 
/ . 0 


552X4 


6.')4 


n A 
y . 6 


Q n 
0 . U 


p r 1 V r 

552X5 


1 /^AA 

10iJ9 


n /I 
y . 4 


7 7 


p p " \'r\ 

55.^X0 


7 T "O 

/2 


1 c 

1^ . b 


1 1 

1 1 . b 


P P ,1 v fx 

554X0 


226 


12.4 


11 X 

li . J 


P P P V A 

555X0 




in 1 
10 . 1 


o . 4 


5o.*>X0 




n A 

y .4 


7 ft 


566X0 


1:)/ 


10 n 
12 . U 


1 n A 
lu . 0 


P "7 1 V A 

5 /iXO 


46 ly 


in n 
lu . U 


0 . 4 


p OAvn 

•bbOXO 


1 


A 7 


A 7 


p o 1 vn 
5 0 1 aU 


421 


y . 


7 A 


p o 0 V n 


7 n(^ 


0 n 

y . u 


7 

/ . b 


p m v A 

syixo 


7 0 


in c 
I'J . b 


7 7 


PHI VI 

byj xi 


1 7 
1 / 


lU . ^ 


Q /I 
o . 4 


600X0 




A A 

9.0 


Q Q 
0 . 0 


601X4 


342 


9.9 


8.5 


602X0 


849 


,9.9 


8.6 


602X1 


704 


9.9 


8.5 


603X0 


4671 


9.4 


7.7 


605X0 


1182 


10.7 


9.4 


605X1 


2476 


9.8 


8.3 



* One stiuidard deviation below mean 
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AFSC 



Average Reading Reduced Reading* 
X Grade Level Grade Level 



007X0 


582 


10.4 


8.9 


011X0 


752 


10.1 


8.5 


012X0 


95 


10.2 


8.6 


020X0 


1 


10.0 


10.0 


021X0 


205 


9.8 


8.4 


022X0 


3774 


9.8 


8.5 


622X1 


259 


11.0 


9.1 


031X0 


4581 


9.9 


8.5 


640X0 


5 


12.0 


11.5 


645X0 


10597 


11.2 


9.5 


647X0 


6184 


9.9 


8.5 


048X0 


253 


12.0 


10.2 


050X0 


2 


11.5 


11.2 


051X0 


414 


12.0 


10.9 


071X1 


1060 


12.9 


12.0 


071X5 


2786 


15.0 


12.1 


672X0 


75 


12.9 


12.0 


075X0 


5 


15.8 


13.5 


090X0 




12.8 


11.5 


091X0 


179 


12.8 


11.7 


700X0 


5 


10.6 


9.0 


701X0 


575 


12.1 


11.0 


702X0 


18756 


10.5 


8.7 


704X0 


55 


11.1 


9.5 


705X0 


225 


11.4 


10.0 


711X0 


510 


10.4 


8.6 


713X0 


92 


11.2 


9.0 


715X1 


81 


10.2 


8.5 


750X0 


15 


11.5 


10.5 


752X0 


4505 


11.6 


10.5 


752X1 


217 


11.7 


10.4 


:^32X5 


25 


11.9 


10.8 


"52X4 


111 


11.7 


10.4 


753X0 


6 


12.5 


11.6 


755X1 




12.6 


11.6 


754X0 


116 


11 .5 


9 8 


741X0 


687 


10.7 


8.9 


741X1 


462 


10.7 


8.9 


742X0 


81 


12.5 


10.7 


751X0 


189 


12.4 


11.1 


75 J XI 


556 


12.0 


10.4 


"51X2 


578 


12.2 


10.8 


751X3 


16 


12.9 


■ 11.6 


755X0 


194 


12.1 


11. 0 


755X1 


3 


9.5 


8.7 


790X0 


1 


14.5 


14.5 


791X0 


520 


14. 1 


12.7 



* OiK'' st^iJidard devinti )n '-f .k^oji 
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AFSC 


X 


Average Reading 
Grade Level 


Reduced Reading* 
Grade Level 


791X1 


131 


13 




11.9 


811X0 


17621 


10. 


0 


8.7 


812X0 


7257 


11. 


4 


9.6 


812X1 


28 


11 . 


3 


9.2 


821X0 


2S 


15. 


0 


12.0 


871X0 


717 


12. 


2 


10. 2 


871X1 


71 


15. 


0 


11 .6 


900X0 


202 


12. 


4 


11.4 


901X0 


420 


12. 


3 


11 .2 


902X0 


5837 


12. 


2 


11.1 


902X2 


650 


12 


4 


11.3 


903X0 


778 


12 


5 


11.3 


904X0 


1158 


15 


0 


11.7 


904X1 


55 


12 


8 


11.5 


904X2 


20 


12 


9 


11.8 


905X0 


409 


12 


.5 


11.3 


906X0 


2026 


12 


2 


11.0 


907X0 


285 


12 


5 


11.5 


908X0 


459 


12 


5 


11.3 


908X1 


52 


12 


5 


11.5 


909X0 


8 


14 


.8 


14.5 


909X2 


15 


12 


1 


10.8 


911X0 


215 


12 


5 


11.2 


912X0 


24 


12 


2 


11.2 


912X1 


15 


12 


0 


11.1 


-/ X. A- 


21 


12 


4 


11.3 


912X5 


59 


12 


5 


11.5 


912X4 


80 


12 


5 


11.2 


912X5 


117 


12 


5 


11.1 


91 5X0 


152 


12 


.6 


11.4 


91 5X1 


40 


12 


6 


11.4 


915X2 


26 


12 


7 


11 .7 


914X0 


183 


15 


0 


11.8 


914X1 


265 


12 


5 


11.3 


915X0 


878 


12 


0 


10.8 


916X0 


47 


12 


6 


11.2 


920X0 




9 


0 


8.5 


921X0 


155 


12 


8 


11.6 


922X0 


1 31 5 


10 


.4 


8.8 


925X0 


187 


12 


5 


11 .2 


981X0 


1601 


12 


2 


11.1 


981X1 


157 


12 


2 


11.0 


982X0 


570 


12 


.4 


11.1 


990X0 


4111 


11 


.4 


8.9 


990X5 


Z8 


11 


.7 


9.4 



* One standard deviation below mean 



ERIC 



3! 

3r, 



AFSC X 


990Xb 


10 


990X9 


124 


991X0 


21 


991X1 


2 


991X5 


851 


991X6 


50 


991X7 


164 


991X8 


78 



Average Reading 
Grade Level 



11.5 
14.5 
12.4 
10.0 
14.3 
12.1 
14.4 
12.5 



Reduced Reading* 
Grade Level 



9.2 

13.6 
10.6 
8.5 
12.7 
10.2 
12.7 
11.2 



* Oi\c Stiijulard deviation below mean 

Average RGL for all per-somiel (272,720) is 10.8 



ERIC 



32 

3G 



